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Abstract 

In [HI a notion of generalized Hadamard product was introduced. We show that when 
certain kinds of tensors interact with the eigenvalues of symmetric matrices the resulting 
formulae can be nicely expressed using the generalized Hadamard product and two simple 
linear operations on the tensors. The Calculus-type rules developed here will be used in [0] 
to routinize, to a large extend, the differentiation of spectral functions. We include all the 
necessary definitions and results from [Hj on the generalized Hadamard product to make the 
reading self-contained. 

Keywords: spectral functions, eigenvalues, Hadamard product, tensor analysis, eigenvalue opti- 
mization, symmetric function, perturbation theory. 

Mathematics Subject Classification (2000): primary: 49R50; 47A75, secondary: 15A18; 
15A69. 

1 Introduction 

The aim of this paper is to develop some analytic tools that, we believe, will fully describe the 
formula for the higher order derivatives of spectral functions in terms of the underlying symmetric 
function. We say that a real- valued function F, on a symmetric matrix argument, is spectral if it 
has the following invariance property: 

F(UXU T ) = F(X), 

for every symmetric matrix X in its domain and every orthogonal matrix U. When U varies freely 
over the orthogonal matrices the invariants of the product UXU T are the eigenvalues of the matrix 
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X. Therefore, de facto, the function F depends only on the set of eigenvalues of X. The restriction 
of F to the subspace of diagonal matrices defines (almost) a function f(x) := F(Diagx) on a vector 
argument x G W 1 . It is easy to see that / : M n — > K has the property 

f(x) = f(Px) for any permutation matrix P and any x G domain/. 

We call such functions symmetric. It is not difficult to see that F(X) = f(X(X)), where X(X) is 
the vector of eigenvalues of X. 

One of the main questions in the theory of spectral functions is what smoothness properties of 
the symmetric function / are inherited by F. The difficulties arise from the fact that the eigenvalue 
map, X(X), don't depend smoothly on its argument X. Even in domains where they are smooth, it 
is difficult to organize the differentiation process so that the result is in as closed form as possible. 

One of the fist results in this direction (see jS]) showed that F is (continuously) differentiable at 
a matrix A if and only if / is, at the vector X(A). The formula for the gradient is compact and easy 
to understand. Next, [7], showed that F is twice (continuously) differentiable if, and only if, / is at 
X(A). The consideration of variety of different subcases made the differentiation laborious and the 
formula for the Hessian of F takes some effort to get comfortable with. Following the developments 
in j7], one can see that an attempt to compute the third, or higher, derivatives of F, will result in 
a number of subcases that will quickly become unmanageable. That is why, deriving a formula for 
the higher derivatives (and in the process proving that they exist) requires a language that handles 
all the cases in a structured way, and allows easy to work with calculus rules. In jS] we proposed 
such a language based on the idea of generalizing the Hadamard product between two matrices 
to a tensor- valued product between k matrices, k > 1. This paper is a continuation of the work 
there. While, jH] emphasizes on multi-linear algebra and combinatorial aspects of the generalized 
Hadamard product, our current work deals mainly with the calculus of the generalized Hadamard 
product that is related to the eigenvalues of symmetric matrices. 

It is likely that high-powered analytical methods will be able to show directly that F is k times 
(continuously) differentiable if and only if / is, see pQ. Our approach aims to give a constructive 
procedure how to, knowing the k-th derivative of F, practically compute the (k + l)-st. The precise 
description of the directional expansion of the eigenvalues of a symmetric matrix, when the entries of 
the matrix depend only on one scalar parameter (see [3], [I]) finds far reaching practical applications 
in areas ranging from optimization to quantum mechanics. Formulae for the derivatives of spectral 
functions will naturally include, as a special case, the directional derivatives, when the symmetric 
matrix depends on one argument. 

The paper is organized as follows. In the next section we introduce the necessary notation 
and definitions. The background definitions and results from jH] that will be needed are given 
in Section El All this aims to make the reading as self-contained as possible. In Section 0] we 
reexamine Lemma 2.4 from [7j. We distill the essential eight parts of the statement of the lemma 
down to two equations: the first is nothing more than a spectral decomposition of a block- diagonal 
symmetric matrix, while the second is a (strong) first-order expansion for dot products between 
(parts of) eigenvectors. The section after that contains the calculus results. The main theorems 
of that section are Theorem 15.11 and Theorem 15.41 They investigate how the interaction between 
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block- constant tensors (see below) and eigenvalues affect the generalized Hadamard product. We 
use these tools in [5] to derive a computable formula for the higher-order derivatives of any spectral 
function at a symmetric matrix X with distinct eigenvalues, as well as for the derivatives of separable 
spectral functions at an arbitrary symmetric matrix. (Separable spectral functions are those arising 
from symmetric functions f(x) = g{x\) + • • • + g(x n ) for some function ijona scalar argument.) 

2 Notation and definitions 

In what follows, M n will denote the Euclidean space of all n x n real matrices with inner product 
(X,Y) = tr(XY T ), and the subspace of n x n symmetric matrices will be denoted by S n . For 
A G S n , \(A) = (Xi(A), X n (A)) will be the vector of its eigenvalues ordered in nonincreasing 
order. By O n and P n we will denote the set of all n x n orthogonal and permutation matrices 
respectively. By we will denote the set {1, 2, k}. For any vector x in W 1 , Diagx will denote 
the diagonal matrix with the vector x on the main diagonal, and diag : M n — > M. n will denote its 
conjugate operator, defined by diag (X) = (in, ...,x nn ). By we denote the cone of all vectors 
x in IR n such that x\ > x<i > ■ ■ ■ > x n . In the whole paper {M m }^ =1 will denote a sequence 
of symmetric matrices converging to 0, {U m }^ =l will denote a sequence of orthogonal matrices. 
We describe sets in IR n and functions on IR n as symmetric if they are invariant under coordinate 
permutations. We denote the gradient of / by V/, and the Hessian by V 2 /. In general, if the 
function / is k times different iable, then V fc /(/x) will denote its k-th order differential at the point 
/i. It can be viewed as a /c-dimensional tensor on M. n . 

Definition 2.1 A k-tensor, T , on W 1 is a map from W 1 x • • • x M. n (fc-times) to M that is linear in 
each argument separately. The set of all fc-tensors on IR n will be denoted by T k,n . The value of the 
/c-tensor, T, at (hi, h^) will be denoted by T[hi, h^}. The tensor is called symmetric if for any 
permutation, a, on it satisfies 

T[h a (i), = T[h x , h k ], 

for any hi, h k G M 71 . 

We denote the standard basis in IR n by e 1 , e 2 , e n . For an arbitrary Axtensor, T, and any 
fc-tuple of integers from N n , (ii,...,ik), we denote its (z'i, ife)-th element by T ll " Ak . (Matrices 
will be viewed as 2-tensors and vectors as 1 -tensors.) If T G T k,n and h G M", then for brevity 
throughout the paper, we denote by T[h] the (k — l)-tensor on W. n given by T[-, •, h}. Similarly 
for T[M], when T is a fc-tensor on M n and M G M n . 

For a permutation matrix P G P n we say that a : N n — * N n is its corresponding permutation 
map and write P <-» a if for any h G M n we have Ph = (h a m, /i CT ( n )) T or, in other words, 
P T e l = e a ^ for all i = 1, ...,n. The symbol 5{j will denote the Kroneker delta. It is equal to one if 
i — j and zero otherwise. 

Any vector \i G M n defines a partition of N n into disjoint blocks, where integers i and j are in 
the same block if, and only if, = fij. Whenever \i is a vector in W? we make the convention that 

Hi = • ■ ■ = /ifcj > /^fci+i = • • ■ = /ifc 2 > /ifc 2 +i • ■ ■ /i/c r , {k = 0, k r = n), 
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with corresponding partition 

(1) h := {1, 2, L x }, I 2 := {Ll + 1, Ll + 2, L 2 }, I r ■■= + 1, ■», ^r}- 

For arbitrary vector fi the blocks it determines need not contain consecutive integers. Thus, 
we agree that the block containing the integer 1 will be the first block, I\, the block containing the 
smallest integer that is not in I\ will be the second block, I 2 , and so on. This naturally enumerates 
all the blocks, and in general, i\ will denote the largest integer in for all / = 1, ...,r. Also, r will 
denote the number of blocks determined by fi. For any two integers, i,j G N n we will say that 
they are equivalent (with respect to fi) and write i ~ j (or i ~^ j) if /ij = fij, that is, if they are 
in the same block. Two fc-indexes (i 1 ,...,i k ) and (Ji,...,jk) are called equivalent if i L ~ j L for all 
I = 1,2, n, and we will write 

(ii, ...,i k ) ~ (ji, j k ). 

Definition 2.2 Given a vector fi G W 1 , we say that a fc-tensor, T, is ( fi-)block- constant if T ll - %k = 
Tn-Jk whenever (ii,...,i k ) ~ (ji,-,jk)- 

A fc-tensor valued map, /i G IR n — > ^{fi) G T fc,n , is block- constant if is //-block-constant 
for every \i. 

The following elementary lemma motivates the definitions following it. It follows from applying 
the chain rule to the equality f{fi) = f(Pfi). 

Lemma 2.3 Let f : M™ — > R be a symmetric function, k times differentiable at the point fi G M. n , 
and let P be a permutation matrix such that Pfi = fi. Then 

(i) Vf(fi)=P T Vf(fi), 

(ii) V 2 f(fi) = P T V 2 /(yU.)P ; and in general 

(in) V s f(ii)[h u h a ] = V s f{fi)[Ph u Ph s ], for any h u h s G R n , and s G N fc . 

Definition 2.4 Given a vector fi G W 1 , we will say that T G T k,n is fi-symmetric if for any 
permutation P G P n , such that P/i = fi, we have 

T[P/i!, Ph k ] = T[h u fe fc ], for any h u /i fc G M n . 

A /c-tensor valued map, fi G M n — > F(fi) G T fc,n , is fi-symmetric if for every /i G M n and permutation 
matrix P we have 

T{Pfi)[Ph x , P/ifc] = /ife], for any hi, h k G W\ 

Clearly, every /i-block-constant tensor is //-symmetric, the opposite is not true. There is a 
slight abuse of terminology since //-symmetric means different things for a /c-tensor and for a k- 
tensor valued map. If the map fi G M™ — > ^(fi) G T k,n is /i-symmetric, then for a fixed fi the tensor 
Ti^fi) is /i-symmetric. This makes sure there will be no confusion. 
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By Lemma 12.31 for any different iable enough, symmetric function / : R n — > R the mapping 
\i G R™ — > V/(/x) G R n is a /i-symmetric, //-block-constant, 1-tensor valued mapping. In general, 
for every s G N fe the mapping \i G R n — > V s /(/i) is a /i-symmetric, s-tensor-valued map, and if 
continuous, then every tensor is also symmetric. 

We conclude this section with the following easy lemma. 

Lemma 2.5 If a k-tensor valued map, \x G R™ — > T(/i) G T k,n , is ^-symmetric and differentiable, 
then its differential is also ^-symmetric. 

Proof. We use the first-order Taylor expansion formula. Let v m be a sequence of vectors 
approaching zero such that w m /||f m || approaches h as m — > oo. 

T((j, + v m )[hi, h k \ = T(fj,)[hi, hk] + VT(fji)[hi, h k , v m ] + o(||w m ||). 

On the other hand, for any permutation P we have 

T(jjl + v m )[h lt h k ] = T(Pfjt + Pv m )[Phi, P/i fe ] 

= T(Pfi)[Ph u P^] + VT(P/i)[P/n, P/i fe , Ptv] + o(||P^||) 
= r(//)[/n, /i fc ] + VT(P//)[P/i 1 , P/i fc , Pt; m ] + o(||i; ro ||). 

Subtracting the two equalities, dividing by ||f m || and letting m go to infinity, we get 

VT{Pii)[Ph x , Ph k , Ph] = T(fi)[h u h k , h}. 

Since the vectors h\,...,h k , and h are arbitrary, the result follows. ■ 



3 Generalized Hadamard product 

In this section we will quote briefly several definitions and results from |H] that are crucial for 
the development in this work. Recall that the Hadamard product of two matrices A = [A l i] and 
B = [B^] of the same size is the matrix of their element- wise product A o B = [A U P U ]. The 
standard basis on the space M n is given by the set {H pq G M n \ H l J = 5 ip 5j q for all i,j G N n }, 
where 5ij is the Kronecker delta function, equal to one if z — j, and zero otherwise. 

Definition 3.1 For each permutation a on we define a-Hadamard product between k matrices 
to be a /c-tensor on R n as follows. Given any k basic matrices H Piqi , H P2 q 2 ,...,H Pk q k 



(H o H o ■ ■ ■ o H yi^-i* 



1, if i s =p s = Vs 
0, otherwise. 
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Extend this product to a multi-linear map on k matrix arguments: 
(2) (H, o a H 2 o a ... o a H k r— = H^- lw ■ ■ ■ H k kl ^ k \ 

Let T be an arbitrary /c-tensor on IR n and let a be a permutation on We define Diag CT T to 
be a 2/c-tensor on M. n in the following way 



(l)iag"V).r ::: ^ 



T* 1 if i s = j ff(fl) ,Vs = l,...,fc, 
0, otherwise. 



Notice that any 2/c-tensor, T, on M n can naturally be viewed as a /c-tensor on M n in the following 

way 

n n 

Pl-Pk 



T[H u ...,H k ]= E T^Hf^-.-H- 

pi,gi=l Pfc,9fc=l 

Define dot product between two tensors in T fc,n in the usual way: 



Pfe9fc 
k 



(T U T 2 )= J2 T Pl - Pk T, 
pi,...,p k =i 



pi-Pk 
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We define an action (called conjugation) of the orthogonal group O n on the space of all /c-tensors 
on M, n . For any /c-tensor, T, and U G O n this action will be denoted by UTU T G T k,n : 

n n 

(3) (UTU r ) il " ik = J2'--J2 (r Pl - Pk U hPl ■ ■ ■ U ikPk \ 

pi=i Pk=i 

It was shown in jS] that this action is norm preserving and associative: V(UTU T )V T = (VU)T(VU) T 
for all U,V G O n . 

The Diag CT operator, the a-Hadamard product, and conjugation by an orthogonal matrix are 
connected by the following formula, see jH]. 

Theorem 3.2 For any k-tensor T, any matrices H\,...,H k , any orthogonal matrix V , and any 
permutation a in P k we have the identity 

(4) {T,H x o a ...o„H k )= (V(Dmg°T)V T )[H u ...,H k ], 
where Hi = V T HiV , % — 1, k. 

Lemma 3.3 Let T be a k-tensor on M. n , and H be a matrix in M n . Let Hi 1 j l ,...,Hi k _ 1 j k _ l be basic 
matrices in M n , and let a be a permutation on N k . Then the following identities hold. 

(i) Ifa~ 1 {k) = k, then 

k—l n 

(T, H njl o a ...o a H ih _ dh _, o a H) = ( J] 5 HMt) ) £ V - 'II 1 '. 

t=i t=i 
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(ii) If a l (k) = I, where I ^ k, then 

k-l 

(T,H ilh o a ...o a II, : ;i ; o a H) = (n^( t )) ri "' ifc " lU(k) H^-^. 

t=i 

4 A refinement of a perturbation result for eigenvectors 

The main limiting tool in [2j was Lemma 2.4. The statement of the lemma was broken down into 
nine different parts, and that lead to the consideration of variety of cases when deriving the formula 
for the Hessian of spectral functions. For general situations, that we aim to tackle later, such case 
studies will quickly become unmanageable. That is why the goal of this section is to transform 
Lemma 2.4 from [7] into a form more suitable for computations. We begin with a lemma (the proof 
is a simple combination of Lemma 5.10 in [B] and Theorem 3.12 in that will alow us to define 
some of the necessary notation. 

Lemma 4.1 Let fiGl" and let (QJ) be the partition defined by /i. For any sequence of symmetric 
matrices M m — > we have that 

(5) A(Dia gyU + M m ) T = /i T + [X(Xf M m Xi) T , \{Xj M m X r ) T f + o(\\M m \\), 

where Xi := [e kl ~ 1+1 , e kl ], for all I = 1, r. 

We need some additional notation that will be used later as well. For a fixed /i e R n and any 
square matrix H, we define 

if i ~ j, 
otherwise, 

if i ^ j, 
otherwise. 

In other words, H in extracts the diagonal blocks from the matrix H and puts zeros everywhere else, 
while i^out extracts the off diagonal blocks and fills the diagonal blocks with zeros. Clearly for any 
matrix H we have 

H = H m + H out . 
Throughout the whole paper, we denote 

(6) h m := (A(X 1 T M m X 1 ) T , X(XjM m X r ) T ) T . 

If also M m /||M m || converges to M as m goes to infinity, since the eigenvalues are continuous func- 
tions, we can define 

(7) h := hm = (X(X^MX 1 ) T , \(XjMX r ) T ) T . 



HI 



12 out 



0, 
0, 
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We reserve the symbols h m and h to denote the above two vectors throughout the paper, unless 
stated otherwise. With this notation Lemma f4. II savs that if M m — > 0, then 

(8) A(Diag/i + M m ) T = l j T + h m + o(\\M m \\). 

Below is the main result of this section. 

Theorem 4.2 Let {M m } be a sequence of symmetric matrices converging to 0, such that M m /||M m || 
converges to M . Let \i be in M? and U m — > U G O n be a sequence of orthogonal matrices such that 

Diag/i + M m = £/" m (Diag A(Diag/^ + M m ))U^, for all m = l,2, .... 

Then: 

(i) The orthogonal matrix U has the form 



U 



( V x 

v 2 



o \ 





V 







V r 



) 



where V\ is an orthogonal matrix with dimensions \Ii\ x |/^| for all I. 
(ii) The following identity holds 

(9) U T M hl U = Diag/i, 

(Hi) For any indexes i G j G I s , and t G {1, ...,r} we have the (strong) first-order expansion 

Sit - s st 



(10) 



v'X = SiA 



O M n 



with the understanding that the fraction is zero whenever 5u = S s t no matter what the denom- 
inator is. 



Proof. This lemma is essentially Lemma 2.4 in jjj. Indeed, Part |(i)| is j?l Lemma 2.4 Part (i)], 
and Part |(ii)| is an aggregate version of Parts (iv) and (vii) from there as well. To prove Part |(iii)| 
we consider several cases. 

Case 1. If i = j G 1\ and t = I, then Formula (fTU^) becomes ^ (U^) 2 = 1 + o(||M m ||), which is 

exactly Part (ii) of Lemma 2.4 in \7\. 
Case 2. If i ^ j G h and t = I, then Formula ffTTJ|) becomes ^ {U%) 2 = o(\\M m \\), which is exactly 

Part (vi) of Lemma 2.4 in [7j. 
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Case 3. If i ^ j G h and t ^ I, then Formula (HUJ) becomes ^U^U™ = o(\\M m \\), which is a 

pelt 

consequence of Part (v) of Lemma 2.4 in [7j. 
Case 4. If % G I h j G I s , with I ^ s + t + I, then Formula (HHJ) becomes ^U%U^ = o(\\M m \\), 

which is a consequence of Part (viii) of Lemma 2.4 in [7j. 
Case 5. If i G Ii, j G I s , with / 7^ s and t = I, then Formula (jlUj) becomes 

E = — ^— ^||M m || + o(||M m ||). 

This formula requires a proof. It will be presented together with the proof of the next, last, 
case below. 

Case 6. If i G ij, j G I s , with / 7^ s and t = s, then Formula (JTUj) becomes 

= — M^||M m || + (||M m ||). 

We now show that the expressions in both Case 5 and Case 6 are valid. Recall that Part (ix) 
from Lemma 2.4 in [2j says that in case when i G //, j G I s with / 7^ s, we have 

/ V fppfTjp jppjjip\ 

llm ^ II a f II + Vk, n^Tl = M ■ 

m-»oo y ||-Mm|| / 

Introduce the notation 

PL := " , for all / = l,2,...,r, 

and notice that 

r 

E^m = 0' f° r a ^ m ' 

because £7 m is an orthogonal matrix and the numerator of the above sum is the product of its 
i-th and the j-th row. Next, Case 4 above says that 



lim E#n = > 



m— too 

t^l,s 



SO 

hm (p l m + p s J = 0. 
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For arbitrary reals a and b we compute 

+ bf3 s J - — (v h (3 l m + » k J s m ) = ((3 l m + (3 s J bfik ' - ^ - 0, 
as m — > oo. This shows that 

lim (a(3 l m + b(3 s J = M ij . 

When (a, b) = (1, 0) we obtain Case 5, and when (a, b) = (0, 1) we obtain Case 6. ■ 



5 Interactions between tensors and eigenvalues 

The interactions that we will investigate between the types of tensors defined in Section 121 and the 
eigenvalues of symmetric matrices lead naturally to two families of linear maps. Each of the next 
two subsections focuses on one of these families and explains how it arises. 



5.1 A family of linear maps: divided differences 

Fix a vector /i G M n . In what follows, the equivalence relation between numbers from N n will be 
determined by vector /i. We define k linear maps 



T G T k ' n T^ t g T k+1 ' n , for 1 = 1,2, k. 



^k,n k rp(l) ^ rpk+l,n 

as follows 



{0, if i\ ~ ik+i, 
rni 1 ...i l _ 1 i k+1 i l+1 ...i k _ rpi 1 ,..i l _ 1 i l i l+1 ...i k 
^ , ifiiT^ifc+i. 

Notice that if T is a //-block-const ant tensor, then so is T Q ^ t for each I = 1, k. The easy-to-check 
claim that these maps are linear means that for any two tensors T\, T 2 G T k,n and a, (3 G K. we have 



(12) (aTx + PT 2 )Z = a(7\C + f3(T 2 )Z, for all I = 1, ...,k. 

One can of course iterate this definition: on the space T k+l,n we can define k + 1 liner maps 
into T k+2 ' n , and so on. We will need a way to keep track of that chain process somehow. A good 
enumerating tool for our needs turns out to be the set of permutations on Nk, Nk+i,---- 

Given a permutation a on we can naturally view it as a permutation on Nk+i fixing the last 
element. Let T\ be the transposition (7, k + 1), for all I = 1, k, k + 1. Define k + 1 permutations, 
(7(7), on Nfc+i, as follows: 

(13) a (i) = an, for I = 1, k,k + l. 
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Informally speaking, given the cycle decomposition of a, we obtain ovn, for each I = 1, by 
inserting the element k + 1 immediately after the element I, and when I — k + 1, the permutation 
C(k+i) fixes the element k + 1. Clearly c^(k + 1) = / for all Z, and 

{All permutations on N^+i} = {<jti \ a is a permutation on N^, / = 1, k,k + 1}. 

Theorem 5.1 Lei {M m ,} be a sequence of symmetric matrices converging to 0, such that M m /\\M m \\ 
converges to M. Let fi be in and U m — *■ U G O n be a sequence of orthogonal matrices such that 

Diag/i + M m = [/ m (DiagA(Diag/i + M m ))[/^, for all m=l,2, .... 

Then for every block- constant k-tensor T on W 1 , any matrices H 1 ,...,H k , and any permutation a 
on Nfc we have 



ljm , U m (V^T)^-m^T , = ^ (Diag „„ r (,) ) [g ^ g M 

m->oo V M m / z — ' 



Proof. Both sides of Equation (|T^|) are linear in each argument H s . That is why it is enough to 
prove the result when H s , for s = 1, k, is an arbitrary matrix, H is j g , from the standard basis on 
M n . Since we have that 



(t/ m (Diag CT T)^-Diag CT T)[^ m ,...,^ u J = {U m {D\^T)Ul)tt - (IMag'TV-l 

we begin by developing the first term on the right-hand side. 

By the definition of the conjugate action and the fact that T is block-constant, we have 



n,...,n k 



p n ,q^=l v=\ 
r]=l,...,k 



J2 T Pl - Pk Ylu^-IA 



p v =l v=\ 
T]=l,...,k 



j2 T pi - pk Y[u^ p "ui (u)P " 



p v =l u=l 
r]=l,...,k 



k 



e ^-^n( e u ^ u - 

tt,=l u=\ p„ei tv 

T]=l,...,k 



Thus, we have to take the limit as m approaches infinity of the expression 

r,...,r k 

il—ik 



T 4 *!- 4 ** J] ( J2 U^ Pv Uk lv)Pv ) - (Diag^T) 
(^(Diag^L^-Diag^T)^-/* h,...,t k =i „=i Vv a iv 



ii...ik 

31— Jk 



\M m \\ \\M m \ 
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Assume that i\ G /„, and j a m G I Sl for all I = 1, k. 

We investigate several possibilities. Suppose first that among the pairs 

(15) (k,ja(l)), («2, ja(2)), (k,ja(k)) 

at least two have nonequal entries. It will become clear, that without loss of generality we may 
assume they are (z'i, an d («2, jo-(2)), that is, i\ ^ ^(l) and 12 7^ ja(2)- Using Expansion (JTUJ), for 
any t±, £2 we observe that: 



r3a(2)V2 



lim E u^u^)( E U - 2U - 

m-^co \\M m \\ V J \ 

= lim Tn^fe^)^ + Ktl ~ 6sitl M^\\ Mm \\ +o(\\M n 



(<W (2) <W 2 + 6v2t2 _ 6s2t2 M^\\M m \\ + o(\\M n 



= lim -^( ^' ltl * 8ltl M^>||M m || + o(||Af m ,||))( ^ 2 ^ 2 M^)l|M m || + o(i|M„ 
™->oo ||M m || V ^ - /i i<T(l) / V [i i2 - /i j(j(2) 

= 0. 

ii...i k 

Since in this case by definition (Diag^T)^-- ^ = we see that the whole limit above in zero. 

Suppose now, that exactly one pair has unequal entries and let it be (ii,j a Q))- We consider two 
subcases depending on whether or not ii and j a m are in the same block. 

If both ii and are in one block, that is V\ — Si, then using Expansion (JTUJ), for arbitrary t, 
we obtain: 

lim TuZlfE^^) = lim JWli 5 ^ 5 ^ + 7T "/*' MHMl) W M ™W + °(1I M - 

™-oo ||M m || / rn^oc\\M m \\\ frt ~ ft,® 

o(\\M m \\) 

= lim 



= 0. 

h—ik 

In this subcase we again have (DiagT)^---.^ = 0, thus the whole limit above is zero. 

If ii and j a ^) are in different blocks, vi 7^ sj, then (DiagT)^---^ = and by Expansion (flOj) we 
obtain: 

k 



'ti,...,tfe=l f=l Pv£h v 



lim 

\\A1, 



tl,...,*fc=l y=l 
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We show that the limit of at most two terms in the above sum are non-zero. Indeed, summands 
corresponding to /c-tuples (ti, ...,t k ) with ti $ {vi, s;} are equal to zero, because S^j,^ = 0, S Vltl = 
5 Sl ti — 0, and therefore 

<W^ + ^_~^' M^(0||M m ll + O (|lM m ||) = o(\\M m \\). 

Similarly, summands corresponding to fc-tuples (t\, ...,tk) with t v ^ v v for some v ^ I are equal to 
zero, since then 5 Vvtv = 5 Sv t v = (recall that v v = s u for all v ^ I). Thus, the summands with possi- 
ble nonzero limit correspond to the /c-tuples (vi, Vi-i, vi, Vi + \, v k ) and (v\, vi-i, si, Vi + \, Vk). 
On the other hand, if t v = v v {— s„) for some v ^ I, then 

<W)^ + Ku ~ 6s ^ M^\\ Mm \\+o(\\M m \\) = 1 + o(\\M m \\). 
Thus, we can calculate that the above limit is equal to 

rpl Vl ...l V[ _ 1 t, V[ l Vl + 1 ...l Vk _ rpi Vl ...i Vl _ 1 L Sl i Vl + 1 ...L Vk rpi 1 ,„i l _ 1 i l i l+1 ...i] < , rrii\ —il-lj a (l)h+l—h 



y»l».il-i*(t(+i».»* _ 2 1 U...ji-ij (T (i)ii+i...«fe 



-M ont 



H3<y{l) 



where the first equality follows from the block- const ant structure of T and the second from the 
premise in this case that i\ and j a n\ are in different blocks. 

In the last case when i v = for all v = 1, k, the limit is equal to 



hm _^('r ii --- i *(i + (||M m ||))-r il -" i *) =o. 

m->oo \\M m V / 



With that we finished calculating the limit in the left-hand side of Equation (|19|) . 

We now compute the right-hand side of Equation ()19|) and compare with the results above. 
Suppose that a(l) = m, then by the definition of we have aVMm) — k + 1, o'nHk + 1) = I, and 

for any integer i G Nfc + i\{/c + 1, m} we have <J~^(i) = o" _1 (z). Below we use the standard notation 
that a "hat" above a term in a product means that the term is omitted. Since a^(k + l) = I ^ k + 1 
we use the second part of Lemma [3.31 to compute: 



(Diag CT WT ( S) [H hjl , H ikjk ,M out ] = ^(T^ t , H hjl o CT(!) ■ • • o aQ) H ikjk o aQ) M out ) 
i=i i=i 

k 

= Yl (r^) n '" JUCT w (fc+1) (5 h j a(l){1) ■ ■ ■ Sij^i) ■ ■ ■ 5 ik ] a(l){k) )M i 
i=i 
k 

- V MO V 1 (s 5~^~---5 ■ \M ja(l)il 

/ j ^/outj \ U n3<r(l) U llJo{l) U lk3a(k)) 1V1 0\lt 



(I) 

out 



=1 
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It is clear that if at least two of the pairs (^2, ja(2)), {ik,ja(k)) have different entries, then 

the sum is zero. Let now exactly on of the pairs have unequal entries, say i\ 7^ j a (i), then the above 
sum will be equal to 

( T (i)yi-ihMD( S lT~ ~ ■ ■ ■ S- ■ )M ja(l)il 

If %\ and j a m are in the same block, then (T^ t y i, "* fc M') = by the definition of T® t . If i\ and j a m 
are not in the same block, then the last expression above is equal to 

. . rpi 1 ...i t _ 1 i l i l+1 ...i k _ rpi 1 „.i l _ 1 j a , l - j i l+1 „.i k . . 

/ T (!)\«i-'U»(i) M 3a{ y> 1 — - - M 13 "^ 

\ 1 o\it) Jw out — 1 — 1 ivJ out > 

nil A*j CT (i) 

because M is a symmetric matrix. Finally, \li v = j a ( u ) for all v — 1, fc, then again (T^ Y 1 " Ak3crm = 
0. These outcomes are equal to the results in the corresponding cases in the first part of the proof, 
the theorem follows. ■ 



5.2 A second family of linear maps: "inflating" diagonal hyper-planes 

Recall that T\ denotes the transposition (I, k + 1) on N^+i- Fix a vector \i £ M n defining the 
equivalence relation on N n . We define k linear maps 



T £ T k ' n -> Ty> £ T k+1 ' n , for / = 1, 2, k. 



^k,n k rpif) r-pk+l,n 

as follows: 

(16) ^ny-iui^ 



r u...t 1 _ii fc+ i. 1+ i„.» fcj if i { ^ i fc+lj 

0, if 2; / l fc+1 . 



Notice that if T is a block-constant tensor, then so is for each / = 1, In that case, we 



CO 



clearly have 

0, if ij ^ z' fe+ i- 

It is again easy to check that these maps are linear, that is, for any two tensors Ti,T2 £ T h,n and 
a, /? £ M we have 

(oTj + /JT 2 )£ = + 0(T 2 )g, for all I = 1, k. 

Define also 

^ ' " \ 0, if i, 7^ z fc+ i. 

In other words, T n is a (/c + l)-tensor with entries off the hyper plane %\ = ik+i equal to zero. On 
the hyper plane %\ = i^+i we have placed the original tensor T. 

Before we formulate the main result or this subsection we need two technical lemmas. 
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Proposition 5.2 Let T be any k + l-tensor, x be any vector in W n , let V be any orthogonal matrix, 
and a a permutation on Then the following identity holds: 

V A (Diag <T (T[x]))V rT = (V(Diag a ( h +^T)V T )[V(Diagx)V T ]. 

Proof. Let H il j 1) ... 1 H ik j k be any k basic matrices. Recall that a^k+i)(i) — f° r & U i G Nfe and 
<T(k+i)(h + 1) = k + 1. Using Theorem E21 twice, we compute 

(V(Di ag ^T[x}))V T )n't = (v(Di^(T[x}))V T )[H lin , ...,H ikh ] 
= (T[x},H hjl o a ... o a H ikjk ) 



n,...,n 

fjPW<r-Hl) _ _ _ o-PfcP<r-l(fc) 
ik'jk 

Plv,Pfc = l 



Erp P l...p k + l x Pk + l JJ PlP «- 1 W . . . JjPkPa-Hk) 
UJ1 l kjk 

Pl,-,Pfc,Pfc+l=l 



n,...,n 



T Pl - Pk+1 H ii:ji { } ■••^• fc (fe+1) (Diagx) 

pi.-iPfc,Pfc+i=i 



= (^Fnj! o CT(fc+1) ... o a(fc+i) H ikJk o a(k+i) Diagx) 

= (V(Diag^)T)V T )[iJ n , 1 ,...,iJ, Ufc ,V(Diagx)U T ] 

= ( {V (Diag ff T) U T ) [V (Diag x) V T ] ) £ :: $ . 
Since these equalities hold for all i\...ik and ji-.-jk we are done. ■ 

The next lemma says that for any block- const ant tensor T, Diag CT T is invariant under conju- 
gations with a block-diagonal orthogonal matrix. 

Lemma 5.3 Let T be a block-constant k-tensor on R n ; let U G O n be a block- diagonal matrix (both 
with respect to one and the same partitioning ofN n ). Then for any permutation a in we have 
the identity 

U(Diag a T)U T = Diag CT T. 

Proof. Let {I\,...,I r } be the partitioning of the integers N n that determines the block structure. 
Notice that \J % "p\J3v = q whenever i j or i ^ p, and that Y2 P ei U tp U^ p = 5ij whenever i G I s . Let 
(ii,...,ifc) be an arbitrary multi index and suppose that i s G l Va for s = 1, We expand the 

left-hand side of the identity: 

n,...,n 

(U(Diag a T)U T )^ k = £ (Diag a T)n-'ikU llPl U nqi ■ ■ - U lkPk U Jkqk 

p s ,q 3 =l 
s=l,...,k 
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)Pk 



— ^ TPi-PkJjiipijjjlPv-H!) . . . TjikPkTjik.P a -i (k) 

Pi,...,p fc =l 
n,...,n 

_ r pPi---PkJjhpijjj a (\)Pi . . . JjikPkJJ'j a {k)Pk 

p lt ...,p k =l 
r,...,r 

— T H l~ H k JjhPlJjjvWPl . . .Jjik.PkJjj„(k 

h,...,t k =l Pi£h t 
l=l,...,k 

_rpi vl ...L Uk JjilPlJjja(V)Pl . . . JjikPkJJ3a(k)Pk 

Pl£l Vl 

l=l,...,k 

Jit. n -l.v k X X. . 

- 1 "UJ CT (1) U ikJa(k) 

- 1 "uj CT (i) u ^k3a(k) 

i\...ik 

= (Diag CT T)ji-^. 

The next to the last equality follows from the fact that T is block-constant. Since the multi index 
(ii, ...,ik,ji, ■■■,jk) wa s arbitrary, the claim in the lemma follows. ■ 



Theorem 5.4 Let U G O n be a block- diagonal orthogonal matrix. Let M be an arbitrary symmetric 
matrix, and let h e W 1 be a vector, such that 

(18) U T M in U = Diag/i. 

Let Hi,...,Hk be arbitrary matrices, and let a be a permutation on Njfc. Then 
(i) for any block- constant {k + 1) -tensor T on M. n , 

(T[h],Hi o a ...o a H k ) = (T, H, o CT(fc+i) ■ ■ ■ o a(k+i) H k o„ (Jk+1) M in ) 

(ii) for any block- constant k-tensor T on W 1 

(T n [h], H\ o a ■ • ■ o CT H k ) = {T£,H X o CT(!) ■ ■ ■ o CT(;) # fe o a{l) Min), /or a// Z = 1, fc, 

where the permutations an), for I = 0, 1, are defined by M'J\) . Hi = U T HiU for all i = 1, fc. 

Proof. To see that the first identity holds we use Theorem 13.21 Proposition 15.21 Formula (|18|). 
and Lemma f5. 31 in that order, as follows: 

(T[h\, H 1 o a ---o a H k ) = (U(Di^T[h])U T ) [H u H k ] 

= (U(Dia 1 g^T)U T )[H 1 ,...,H hl U(Dia 1 gh)U T } 
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= (U(Bmg^T)U T ) [H u H k , M in ] 
= (Diag^r)^,...,^,^,] 

= (T, Hi CT(fe+1) ■ ■ • CT(fc+1) H k CT(fe+i) Min). 

The last equality follows again from Theorem 13.21 

To show the second identity, since both sides are linear in H s for every s = 1, k, it is enough 
to prove it only in the case when H s is an arbitrary basic matrix H is j s . Fix k basic matrices 
H ix j xr ..fli k j k and suppose that i s G I Us for s = 1, k. The left-hand side is equal to 

(T n [h], H ivh o a ■ ■ ■ o a H ikjk ) = (U(Bi ag ^[h])U T )[H lin ,...,H lkj 

= (U(Diag a T n [h])U T y 



L lk3ki 

H...t k 

\h-jk 



x ^ P\---Pk ■ ■ 

(Diag a T T '[h})n-^U nPl U nqi ■ ..U lkPk U Mk 



pi,...,p k =i 

q lr ..,q k =l 



l3kP a ~\ 



_ ^ (T n [h]) pl '" pk U ilPl U^ lp < T ~ 1 w ■ ■ ■ lf ikPk U J 
pi,...,p k =i 

n,...,n 

— ^JiTi^ l Jjpi...pkfjiipiJJ3v(i)Pl . . . JjikPkJJ3a{k)Pk 

pi,...,p k =l 
n,...,n n 

— (j^nyi---PkPk+if l Pk+ijjhpijjj<T{i)Pi . . .jjikPkjjja(k)Pk 
pi,...,p k =i Pk+i=i 

n,...,n 

— r pPl---Pkf l PlljilPllJ3cr{l)Pi . . .JjikPkJJ3a(k)Pk 

p 1 ,...,pk=l 

r,-,r 

— *y~^ rpt, ai ...t, Sk faPlJjhPlJjj a (l)Pl . . . JjikPkJJ3a(k)Pk 

S 1 ,...,S k = l P-n&Isr, 
rj=l,...,k 

rpi 1 ...i k e . \^ UPlTplPlTJ3a(l)Pl 

1 U H3<y(l) U H3<t{1) u ik3a(k) 

Pl&I^X 

— Tn-ikX T~ ...x . M Hj ' T(l) 

X "UJ CT (1) U ilJa(l) U lk3a{k) 1V1 \Tl 

Now we evaluate the right-hand side of the identity. We will use the second part of Lemma since 
Cm (A; + 1) = I ^ k + 1. Recall also that <J(i)(s) = <r(s) for s G Nfc+i\{Z, A; + 1} and cr^(k + 1) = cr(/) 
for all I — 1, .... fc. 



frprtyi-ikMi) 5 f . . . g. . \// 



( r nyi...« CT(i) ( fe+1)(5 £TZ ,---5 ikj m M ir /"' 



t(1) ^HJk + l HJcr(fe) in 

17 



j-<h~. 






■■5 ikj M 3 ° {l)tl 

l kJa{k) in 


rph... 


ik 5- ■ 


^iijk+i ' 


. .$. . M kja{l) 

u ^kJ rT (k) lvl m 


rpil... 


u *u CT (i) 




■■8- M kUl) 



In the third equality above we used the fact that T is block- const ant, plus the fact that M^ 0)H = 
if j a m rfj i t . In the fourth we used the fact that M is a symmetric matrix. The last equality holds 
because we changed the format of the missing multiple, while keeping the present multiples the 
same. ■ 



Proposition 5.5 Let U G 0(n) be an block-diagonal orthogonal matrix, let H be an arbitrary 
n x n matrix, and a an arbitrary permutation on f%. 

(i) If T is a (A; + l)-tensor such that for some fixed I G we have T pl "' Pl " ,Pk+1 = whenever 
Pi ~ p k+ i, then 

(f/(Diag CT (OT)f/ T )[# in ] = 0. 

(ii) If T is a (A; + l)-tensor such that for some fixed I 6 we have T Pl "' Pl " ,Pk+1 = whenever 
pi Pk+h then 

(U(Dmg^T)U T )[H out ] = 0. 

(iii) If T is any (k + l)-tensor, then 

(U(Dmg^T)U T )[H out }=0. 

Proof. Fix an index / in Let H il j 1 ,...,H ik j k be arbitrary basic matrices, and let H be an 
arbitrary matrix. Using the definitions we compute. 

n,n ■ : 

(U(Dmg^T)U T ) [H hjl , H ikjh ,H] = ^ ([/(Diag^r)^)^"^^ 1 ^ 1 

ik+i J*+i=l 

n,n n,...,n 

= (Diag CT w T')9i""'^+it/ ilPl f/ ;7191 ■ ■ • Jj ik+lPk+1 U ik+iqk+1 H ik+1 ^ k+1 

s=l,...,fc+l 
n,n n,...,n 

— -v JlP -l M x Jk+lP -1,. 

\^ jipx-Vk+ijjnpijj . . .jj l k+iPk+ijj CT (i, ( fe+1 )^fe+iJfe+i 

*fc+ljfc+l=l Ps=l 

s=l,...,fc+l 



n,n n,...,n 



ypi---Pfc+if/*ipif/^(i)(i) pi . . . jjhPijji<*{i)V) pi . . . jjik+iPk+ijj^(i)(. k + i ) pk + i ffik+ijk+i 



»fc+i,ifc+i=i p s =i 

s=l,...,fc+l 
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n,...,n 



— J r Pi---Pk+iJjhpijjj< 7 (i)Pi . . . TJHPiTjik+iPi . . . Jjik+lPk+ll/ia{l)Pk+i ffih+dk+i 

*fc+lJfc+l = 1 Ps=l 

s=l,...,k+l 

Suppose now that T is a (A; + l)-tensor with T pi - pi ~ ,pk+1 = whenever pi ~ and that H = H in . 
Then H lk+1 ^ k+1 ^ implies that i^+i ~ jk+i- m that case, by the fact that U is block diagonal, 
jjik+iPijjik+iPk+1 ^ o implies that p x ~ p k+1 , which implies that T Pl - pi - pk + 1 = 0. Thus every 
summand in the double sum above is zero. 

In the second case, suppose T is a (k + l)-tensor with T pi - pi - pk+1 = whenever ^ pk+i and 
iJ = i? ou t. Then H lk+1 ^ k+1 ^ implies that i k+ i ^ j k+1 . In that case, by the fact that U is block 
diagonal, U jk+m U ik + lPk+1 ^ implies that p x ^ Pk+U which implies that T Pl - pi - Pk + 1 = 0. The sum 
is zero. 

In the third case, suppose that T is any (A: + l)-tensor and H = H out . A calculation almost 
identical to the above one (it differs only in the last step) shows that 

(U(Dmg^T)U T ) [H hjl ,..., H ikjk ,H] = 

n,n n,...,n 

j^pi---Pk+ijjhpijjj^(i)Pi . . . jjikPkjjjcr(k)Pkjjik+iPk+ijjjk+rPk+ijjik+ijk+i 

«fc+ljfc+l = l Ps=l 

s=l,...,fc+l 

Then H lk+1 ^ k+1 ^ implies that i k +i ^ jk+x- in that case, by the fact that U is block diagonal, 
jjjk+iPk+ijjik+iPk+i = o. Again the sum is zero. ■ 

The next result is a consequence of Theorem 13.21 Theorem 15.41 and Proposition 15.51 applied 
with U = I and using the fact that M = M in + M out . 

Corollary 5.6 Let U G O n be a block- diagonal orthogonal matrix and let a be a permutation on 
Nfc. Let M be an arbitrary symmetric matrix, and h G IR n be a vector, such that U T M m U = Diag/i. 
Then 

(i) for any block- constant {k + 1) -tensor T on W 1 , 

U(Dmg a {T[h]))U T = (Diag^ 1 ) T)[M]; 

(ii) for any block- constant k-tensor T on M. n 

U(Dia,g a (T Tl [h]))U T = (Diag ff «72)[Af], for all I = l,...,k, 

where the permutations am, for I G N k , are defined by (Q3J). 

Notice that if the vector /i, defining the equivalence relation on N n , has distinct coordinates, 
then every tensor from T k,n is block- const ant and the block-diagonal orthogonal matrices are pre- 
cisely the signed identity matrices (those with plus or minus one on the main diagonal and zeros 
everywhere else). In this case we also have i ~ j if, and only if, i — j and thus = T Tl . Moreover, 
since Proposition 15.51 holds for arbitrary matrices (symmetric or not), we obtain the next result, 
valid for an arbitrary matrix H. 
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Corollary 5.7 Let a be a permutation on r% and let H be an arbitrary matrix. Then 



(i) for any (k + 1) -tensor T on W 



n 



Diag CT (T[diag#]) = (Diag CT c* +1 >T) [H]; 



(ii) for any k-tensor T on W 



n 



Diag ff (T Ti [diag#]) = (Diag^T 7 "') [H], for all I = 1, k, 



where the permutations am, for I G N^, are defined by ilfy) . 

Finally, combining Theorem 15 . 1 1 and Proposition 15.51 we get the next corollary. 

Corollary 5.8 Let {M m } be a sequence of symmetric matrices converging to 0, such that M m /||M m || 
converges to M . Let \i be in W[ and U m — > U G O n be a sequence of orthogonal matrices such that 



6 A determinant connection 

Let T G T k ' n be any /i-symmetric tensor on R n . A little bit of thought shows that T can be 
decomposed into T = A + B, where A,B£ A is a block-constant tensor and B has the 

following property: for every multi index (ii,...,^) with pairwise distinct entries, £> n --- lfe = 0. In 
this section we investigate a rather curious fact about tensors with the last property. 

For any two vectors x, y G we say that y refines x (or that x is refined by y), and write 
x di U, if Hi = Uj implies Xi = Xj for any i,j G f%. 

Lemma 6.1 Let T 1; T 2 ,...,T S be s-tensors on ~R n with the following two properties: 
(i) for every multi index (ii, ...,i s ) we have 



Diag/x + M m = C/ m (DiagA(Diag// + M m ))£^, for all m = l,2,.... 



Then for every block- constant k-tensor T on M. n , and any permutation a on Nk we have 




(19) 



n\...l a rpn 
1 5 1 2 



- 'IV -'*) d (/, /.)• 



(ii) Whenever the multi index (ii, ...,i s 



) has pairwise distinct entries, then T { 



for all I. 
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For any two multi indexes (ii,...,i 8 ), (ji,---,js) with entries from the set N n we define the s x s 
matrix, AQj;;;^), as follows: 



/\(H...is\pq 



rpvx- 
V 



'<W ifq = s, 



then det(A(£::;£)) = 0. 



Proof. Fix a multi index (it, ...,i 8 ). If it has pairwise distinct entries, then by the second property, 
the last column in the matrix AQj;;;* s J will be zero. If two of its entries i 8l and i S2 are equal, then 
by the first property, row si will be equal to row s 2 and again the determinant will be zero. ■ 



Note 6.2 The second condition in the preceding lemma in trivially satisfied if s > n. 

Proposition 6.3 Suppose thatT\, Ti,...,T s be s-tensors on W 1 with the two properties in Lemma UTH. 
then the following identity holds: 

s 

(20) Yl $>ign(a (0 )Diag CT (OTi = 0. 

(TCP 3 - 1 1=1 

Proof. Fix an arbitrary multi index Qj'"}*)- In the following calculation, the third equality uses 
the facts P s = {a m | a G P s ~\ I G N s } and = s for I G N„ o G P s ~\ 

s s 

( E E si s n (^)) Dia g CT(or }i:::}: = E E^W^-H^w'-^w 

creps-l 1=1 aeP 3 - 1 1=1 

= det(A(£;;£)) 
= 0, 

where A(^;;;* S J is defined in Lemma f6. II for the family of tensors Ti, T2, T s . ■ 

Recall the definitions of the linear maps T G T k > n -> T ( u } t G T fc+1 ' n , for / G N fc . For convenience 
in this section we also define 

T ( J t +1) = 0, for every T G T fc ' n . 

Lemma 6.4 Suppose that T G T fc ' n a symmetric tensor such that T ll '" lk = for any multi index 
(ii, ...,ik) with pairwise distinct entries. Then the k + 1 (k+ l)-tensors 

T (l) T (2) T (k) T (fc+1) 
out ) - 1 out ) • • • ) 1 out ) 1 out 

satisfy the two conditions in Lemma \b'. II s = A; + 1). 
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Proof. To show the first property, fix a multi index (ji, ik+i) and suppose that i p = i q for 
some \<p<q<k + l. If q = k + 1, then (T^)* 1 '"'"* 1 = (T*&y i '" ih+1 =0. If q < k + 1, then 



2^1- 


■■ 4 p-l l fc + l*p+l---*q-l l 9 4 g+l- 


■■'k 








Mifc+i — Mijj 










..ip— iigip+i...ig— 




_ j^i ■ 






Mifc+i ~~ ^ip 










••ip— itptp+i—ig— lifc+itg+i' 


-ifc 


_ yii. 


-ifc 



A'ife+l A*i g 

(rp(q)\h-ik+l 

where in the second equality we used the fact that T is symmetric, while in the third we used 

lp lq. 

The verification of the second condition in Lemma 16.11 follows immediately from the fact that 
T has that property. ■ 

Using the fact that T Q ^ t +1 ' ) = 0, we obtain the next corollary from Proposition 16.31 

Corollary 6.5 Suppose that T e T k,n is a symmetric tensor such that T* 1,,,lfe = for any multi 
index (z'i, ...,ik) with pairwise distinct entries. Then we have the following identity: 

k 

(21) £ ^sign(a (0 )Diag^ T « = 0. 

CTg pfc 1=1 

7 Lifting of a tensor determined by the cycle type of a 
permutation 

The goal of this final section is to prove a result in the spirit of Corollary 15.61 

It is well known that every permutation v on has a unique decomposition into a product 
of disjoint cycles. Denote by s the number of disjoint cycles. These cycles partition the set of 
integers, in a natural way: two integers j, i G Nk are in the same partition if v l (i) = j for some 
I. We enumerate the sets in the partition in the natural way: let I U) i be the set of the partition 
that contains the integer 1; let be the set that contains the smallest integer not in I Uy i; let 
be the set containing the smallest integer not in I v \ U and so on. 

Take a vector x G M fc . We will say that the permutation v refines vector x (or that x is refined 
by u), and write x ^ v, if Xi = x v n\ for every I = 1, 2, k. In order to know a vector x, refined 
by v, it is enough to know the value of one coordinate with index from every cycle of v. In other 
words, for a fixed x, refined by v, the vector (pi, ...,p s ) defined by 

pi := Xi, for every I G N s and some i G I V) i, 
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completely specifies x given v. The ordering on the cycles of v, we agreed on above, makes sure 
that this is a one-to-one correspondence between R s and the set {x G M fc | x ^ v}. 

Let now T be a tensor from T s,n . (Notice that the dimension of the tensor is equal to the number 
of cycles of v G P k .) Clearly s < k with equality if, and only if, v is the identity permutation. We 
define T v to be a tensor from T k,n defined component wise by 

(r >y 1 ...iM = { I* 1 "*', if (ii, ...,i fc ) =< ^ 
1 0, otherwise, 

where (pi,...,p s ) is the vector that specifies (ii, ...,«&) given v. Informally speaking, T v has the 
tensor T placed on the diagonal "subspace" defined by the coordinate equalities {ii = i v n\ \ I G N^} 
and zeros every where else. 

When T\ is the transposition (I, k + 1) on Nfc+i, this definition coincides with the definition of 
T n given by Equation (JT7J). 

Fix a vector \x G W 1 . For the rest of this section, when a block-constant tensor or a block- 
diagonal matrix is mentioned, it will be understood that the blocks are determined by the vector fi 
as explained in Section |21 Let M be a symmetric matrix and h G R n be such that 

(22) U T M in U = Diag/i, 

for some block-diagonal orthogonal matrix U G O n . 

Lemma 7.1 For any block- constant tensor, T , on W 1 we have 

T[h] = TfdiagM], 

where vector h and matrix M are defined by Equation \2ty . 

Proof. Suppose that T is a /c-tensor. The proof is a direct calculation from the definitions: 



(T[h]) il " Ak - 1 = ^2T h - ik - lik h ik 

r 

1=1 ieii 

r 

— ^ y rpl 1 ...i k _ 1 L i ^ ^ Jy[i 

1=1 ieii 
n 

— ^ y rpii... ik-iik J^hh 

= (TfdiagM])* 1 "^- 1 . 
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Proposition 7.2 Let u be a permutation on Nk+i with s disjoint cycles such that u(k + 1) = k + 1. 
Then for any block-constant tensor T in T s,n we have the identity: 

(23) T u [h] =T 1/ [diagM], 

where vector h and matrix M are defined by Equation 



Proof. If the multi index (z'i, i*., ik+i) is refined by z/, then (ii, if., j) is also refined by v 
for any j G N n . Moreover, the vector that specifies it (given v) will look like (pi,P2, ■■■,Ps-i,h+i) 
because vik + 1) = k + 1 and the cycle containing the integer k + 1 has one element. There- 
fore, as (z'i, ifc, ifc+i) goes over all possible multi indexes of dimension k + 1, refined by u, 
{piiP2i ■■■iPs-ii'ik+i) w ih g° over ah multi indexes of dimension s. This correspondence is one- 
to-one. Fix an arbitrary multi index, (ii, z^, ik+i)- If it is not refined by u, then 



(T u [h}) n - ik = (T u ) il - ikik + 1 h ik + 1 = 0, 
't+i=i 

and similarly the right-hand side of (J23j) is equal to zero. If the multi index is refined by u, then 
using the previous lemma we compute: 

{T V \h\) il '" ik = ^ ^ (jvsyi—ikik+i foik+l 

ifc+i=l 
it 

= 'y y j^pi—Ps-iik+i^k+i 

i*+l=l 
= (T[h]) Pl - p *- 1 
= (T[diagM]) pl - Ps - 1 

n 

= Y T pi - ps - lih + 1 (diagM) ih + 1 

»fe+i=l 

= (T^diagM])* 1 -**. ■ 

The following result complements Corollary 15.61 It follows by combining Proposition 17.21 and 
Corollary 15.71 

Corollary 7.3 Let v be a permutation on Nk+i with s disjoint cycles such that vik + 1) = k + 1. 
Then for any block-constant tensor T in T s,n and permutation a on N*. we have the identity: 

(24) Diag a (T u [h] ) = (Diag CT ( fc+1 > T u ) [M] , 

where vector h and matrix M are defined by Equation 
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